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S PECIFICATION 



TO ALL WHOM IT MAY CONCERN: 

BE IT KNOWN that we, KEN TSUTSUGUCHI, a subject of 
Japan and residing at Yokosuka-shi, Kanagawa, Japan, YASUHITO 
SUENAGA, a subject of Japan and residing at Nagoya-shi, Aichi, 
Japan , YASUHIKO WATANABE , a subject of Japan and residing at 
Yokohama-shi, Kanagawa, Japan and NOBORU SONEHARA, a subject 
of Japan and residing at Zushi-shi, Kanagawa, Japan have 
invented certain new and useful improvements in 

"METHOD FOR GENERATING ANIMATIONS OF A 
MULTI-ARTICULATED STRUCTURE, RECORDING MEDIUM 
HAVING RECORDED THEREON THE SAME AND ANIMATION 
GENERATING APPARATUS USING THE SAME " 

and we do hereby declare that the following is a full, clear 
and exact description of the same; reference being had to the 
accompanying drawings and the numerals of reference marked 
thereon, which form a part of this specification. 
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* TITLE OF THE INVENTION 

METHOD FOR GENERATING ANIMATIONS OF A MULTI -ARTICULATED 
STRUCTURE, RECORDING MEDIUM HAVING RECORDED THEREON THE SAME 
• AND ANIMATION GENERATING APPARATUS USING THE SAME 

5 BACKGROUND OF THE INVENTION 

The present invention relates to a method for generating 
animations of a human figure modeled by a multi-articulated 
structure in computer graphics (CG) and, more particularly, 
to a method for generating animations of shoulder rotation 
10 and arm swing of a human figure modeled by a multi-articulate 
d structure constructed by rigid bars or sticks connected or 
joined by joints, a recording medium having recorded thereon 
the method and an animation generating apparatus using the 
method . 

15 In conventional methods for generating human figure 

animations, it is customary to model human arms, legs, body, 
head and so forth as multi-articulated structures constructed 
from rigid links coupled by joints just like a robot arm. In 
this instance, the position and direction of each link are 

20 represented by polar or cylindrical coordinates parameters or 
Euler angles. In a D-H method (Denavit-Hartenberg method), a 
joint-link parameter of an i-th link in a multi-articulated 
structure constructed by plural links sequentially coupled by 

joints is represented by Jointi=[a i ,a i ,d i ,6 i ] to express link 
25 motions (K.S.Fu. et al, "ROBOTICS: Control, Sending, Vision, 

and Intelligence," McGraw-Hill, 1987). In either case, the 
method for generating animations of various parts of the 
human body by the use of such parameters utilizes ( 1 ) an 
interpolation scheme that employs linear or elementary 
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f unctions , (2) a scheme that formulates an equation of motion 
and performs numerical calculations to satisfy initial and 
. final conditions , or (3) a scheme that uses motion data 
obtained by extracting feature parameters of joint positions 
5 in the human body from an image taken by a video camera or 
measuring positional changes of the human body by a magnetic 
or electric sensor. 

The creation of animations through the use of these 
parameters requires skill and is low in operation efficiency 

10 because it is hard to judge how these parameters directly 

(visually) contribute to the magnitude or direction of, for 
instance, arm or leg motions, or because the individual 
parameters cannot directly be controlled, or because it is 
difficult to control a motion generating method for each 

15 parameter. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide an 
animation generating method according to which, in the 
generation of an animation of a human figure modeled by a 

20 multi-articulated structure using rigid sticks joined by 

joints, parameters contributing to the motions of respective 
rigid sticks are easy to identify and individually 
controllable and motion generating schemes for the respective 
parameters can freely be selected or combined. 

25 Another object of the present invention is to provide an 

animation generating method using the above method and a 
recording medium with the method recorded thereon. 

The animation generating method according to the present 



-3- 

■s 

' invention models the human body including shoulders and arms 

by a multi-articulated structure made up of plural rigid 
. sticks connected by joints and generates the modeled human 
figure motions. This method comprises the following steps: 
5 (a) defining constraint planes in which the modeled rigid 

sticks of the arms are allowed to move about the joints 
connecting them; 

(b) determining parameters that define angular positions 
of the modeled rigid sticks of the arms in the constraint 

10 planes, respectively, and creating motion models of the rigid 
sticks each corresponding to one of the parameters; and 

(c) generating motions of the rigid sticks by calculating 
temporal variations of the parameters. 

The animation generating apparatus according to the 
15 present invention models the human body including shoulders 
and arms by a multi-articulated structure made up of plural 
rigid sticks connected by joints and generates human figure 
animations. This apparatus comprises: 

configuration modeling means for disposing the rigid 
20 sticks of the arms in respective constraint planes; 

shoulder position calculating means for calculating the 
positions of the shoulder joints; 

motion modeling means for determining motion models 
representing motions of the rigid sticks of the arms; and 
25 arm angle calculating means for calculating angular 

positions indicating the orientations of the arms at a given 
point of time in accordance with the motion models. 
BRIEF DESCRIPTION OF THE DRAWINGS 



-4- 

Fig. 1 is a diagram showing an example of a multi-articul 
ated structure model, for explaining the principles of the 
i present invention; 

Fig. 2 is a block diagram illustrating an embodiment of 
5 the animation generating apparatus according to the present 
invention; 

Fig. 3 is a diagram showing a model in the case where 
parameters for shoulders in the multi-articulated structure 
model of Fig. 1 are increased; 
10 Fig. 4 is a diagram showing a multi-articulated structure 

model in the case where upper and lower arms lie in different 
constraint planes in Fig. 1; 

Fig. 5 is a block diagram illustrating another embodiment 
of the animation generating apparatus according to the 
15 present invention; 

Fig. 6 is a diagram for explaining the modeling of 
motions of upper and lower arms in the same constraint plane; 
and 

Fig. 7 is a block diagram illustrating still another 
20 embodiment of the animation generating apparatus according to 
the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 1 schematically illustrates a multi-articulated 
structure and motions of its respective parts , for explaining 
25 the principles of the present invention. According to the 
principles of the present invention , the human body is 
modeled by a multi-articulated structure including both 
shoulders and both arms formed by linking rigid sticks with 



joints , the arms each linked to one of the shoulder joints 
are allowed to rotate in a constraint plane passing through 
the link, and the position of the arm is defined by its angle 
to a reference line in the constraint plane. Hence, a 
5 parameter that defines the position of the arm is only an 
angle, and since the angle directly represents the angular 
position of the arm in the animation, motions of respective 
parts of the multi- articulated structure can easily be set 
in the production of the animation and angular position 
LO control is simple. 

In Fig. 1, let it be assumed that a rigid stick 11 of a 
length 2W joining left and right shoulder joints 13 L nd 13 R is 
a modeled version of both shoulders of the human body and 
that the center 0 of the rigid stick 11 is set at a reference 
.5 position (x 0 ,y 0 ,Zo) in a coordinate system (x,y,z). The 
normal of a circle 14 of rotation of the rigid stick 11 on 
the y axis (a vertical axis) passing through the center 0 of 
the rigid stick 11 vertically thereto represents the axial 
direction of the human body (the direction of the backbone). 
0 In the Fig. 1 example, the circle 14 sits in an x-z plane, 
but as will be described later on, the plane of the circle 14 
need not always to cross the y axis at right angles thereto. 
The right shoulder joint 13 R has rotatably connected thereto 
one end of the right upper arm 12 1 modeled by a rigid stick, 
5 to the other end of which is rotatably connected the right 
lower arm 12 2 similarly modeled by a rigid stick. The 
coordinates (x s ,y s ,z s ) of one end of the rigid stick 11 (i.e. 
the shoulder joint 13 R ) in the 3D space are unequivocally 
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determined by the following equation, based on an angle 6 
between the projection of the rigid stick 11 to the x-z plane 

* and the z axis and the shoulder width 2W. 

x s = x o +Wsin0 
5 Ys = Yo 

z s = Zo+Wcos0 

Suppose that the motion of the upper arm 12 x of a length 
Li is constrained in a plane 15 containing a tangent 15a to 
the circle 14 at the upper end of the upper arm 12i, that is, 
10 at the shoulder joint 13 R . This plane will hereinafter 

referred to as a constraint plane. In other words, the upper 
arm 12 1 is rot at able about the shoulder joint 13 R in the 
constraint plane 15. The angular position of the upper arm 

12 x is defined by an angle fa between the upper arm 121 and a 
15 reference line 15b that is a straight line along which a 
plane containing the rigid stick 11 and the y axis crosses 

the constraint plane 15. An angle p that the constraint 
plane 15 forms with the y axis represents a tilt angle of the 

upper arm 121 from the body and an angle pi of the upper arm 
20 12i to the reference line 15b the angular position of a swing 
of the upper arm 12 1 from the body in the front-to-back 
direction. Similar angular positions of the right arm are 
also defined though not shown in Fig. 1. 

In the example of Fig. 1, the motion of the lower arm 12 2 
25 of a length L 2 connected to the lower end of the upper arm 12 a 
(that is, to the elbow joint 16) is also constrained in the 
same constraint plane 15 as that of the upper arm 121 and its 
angular position is defined by an angle (j) 2 that the lower arm 



12 2 forms with the upper arm 12 1 . The parameter <|) 2 
representative of the angular position of the lower arm 12 2 is 
* also a parameter that directly indicates the attitude of the 

lower arm 12 2 of the human figure model. 
5 In contrast to the above, the prior art uses the 

coordinates (x,y,z) to represent the positions of feature 
points of a human figure animation (for example, an eye, a 
nose, tiptoe, an elbow, etc.) and generates an animation by 
expressing their motions using a linear interpolation or 
0 equation of motion, but in the case of using the coordinates 
(x,y,z) as parameters, it is no easy task for an observer to 
comprehend or grasp the attitude of the 3D animation. Also 
in the case of using cylindrical or polar coordinates, the 
angle parameters are not easy to grasp because the parameter 
representation does not match the actual human instinctive 
control. That is, since it is hard to learn which motion 
each parameter contributes to, it is no easy task to 
instinctively determine, for example, movement limits of 
respective parts of the human figure for generating an 
animation. 

That is, the parameters p, and <|> 2 , which define the arm 
12 to which the present invention is applied, are parameters 
that enable the observer to directly understand the attitude 
of the human figure model and it is clear the motion to which 
each parameter contributes; therefore, these parameters are 
easy to use for governing the generation of human figure 
animations. Hence, the present invention has its feature in 
that motions of human arms are represented by changes in the 
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' arm positions defined by angle parameters in the constraint 
plane as referred to above. 

In this way, according to the present invention, the 
position of the arm of the human figure is defined by the 
5 angle parameters in the constraint plane and the arm motion 
or swing is expressed using temporal variations of the angle 
parameters as described below. 

The modeling of the arm motion through utilization of the 
angle parameters can be done, for example, by (1) 
10 interpolating between two boundary conditions, (2) using an 
eguation of motion that satisfies two boundary conditions, 
and (3) using measured data. 

With the motion modeling method by linear interpolation, 

letting the angles <fo. and (j> 2 be represented by generalized 
15 coordinates q and the coordinate at time t by q(t), the 
coordinates at time ti and t 2 by q 0 =q(t 0 ) and qi=q(ti), 
respectively, the angular positions <t> a (t) and <j> 2 (t) of the 
upper and lower arms at time t by the simplest uniform- 
angular-velocity linear interpolation are given by the 
20 following equations: 

♦,(.)- - ♦■ ( ' l t ) 'f l(,,) -' + ♦.(«.) (i) 



+2 (*) * r~i t + Mto) (2) 



where t 0 stst! and -tK^ti, 0«j) 2 <7T. This linear interpolation 
is a motion modeling scheme that approximates the angle 

25 parameters <|>i and <j> 2 , regarding them as linear variables of 
time. 
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An example of a nonlinear interpolation for modeling a 
motion is a sine interpolation scheme. Approximating the 
• human arm swing by sine functions so that the angular 
velocity of the arm swing becomes zero at its both swing 
5 limits, the angular position of the arm can be expressed by 
time variables as follows: 

d *i , x . Jt(t-t 0 ) 

__ =COi(t) _ asm __ (3) 

d <j>2 rcft-t 0 ) 

1T° <M*) - bsin ; (4) 

where : 



15 



rcfci (ti)-4>i(t 0 )} 



3= 2( tl -t 0 



. "{<l>2(tl)-^(t,)} 

b= 2( tl -t 0 ) < 5 > 

As an example of modeling by an equation of motion 
according to the law of physics, a motion of each part can be 
expressed by the following Lagrange's equation of motion 



dL 



dt L d q 



5L 



where L is the Lagrangian of this system, q generalized 
coordinates of this system and Fq a generalized force 
concerning q. 

Fig. 2 illustrates in block form the configuration of the 
20 multi-articulated structure animation generating apparatus 
according to the present invention, indicated generally by 
20. The animation generating apparatus 20 comprises a 
configuration modeling part 21, a joint position 
determination part 22, a motion modeling part 23 and an angle 



' calculation part 24. The configuration modeling part 21 is 
connected to an input part 6 that inputs information 
•necessary for representing motions of the arm 12. The angle 
calculation part 24 outputs its calculated angular position 
5 of each rigid stick and provides it to a display part 7, 
which projects a 3D multi-articulated structure constructed 
by rigid sticks onto a 2D plane, thereby displaying an 
animation of the projected model. 

Any of the above-mentioned methods can be used for 
10 modeling of the arm motion. The information necessary for 
the generation of the animation of the arm 12, for example, 
the coordinates (x s ,y s ,z s ) of the shoulder, the length L a of 
the upper arm 12 lr the length L 2 of the lower arm 12 2 , initial 

angular positions fa and fa of the upper and lower arms and 
15 initial angular velocities at the initial angular positions, 
are input into the configuration modeling part 21. In the 
case of using the equation of motion, the mass of each of the 
upper and lower arms is also input. 

The configuration modeling part 21 models the arm 12 by 
20 approximating the arm structure with a physical pendulum 
formed as a rigid body, determines various physical 
quantities (the lengths, mass, centroids, maximum expansion 
angle, maximum bend angle and moment of inertia of the upper 
and lower arms, and outputs these arm models and its 
25 determined physical quantities. 

The joint position determination part 22 calculates the 
position of the shoulder joint 13 R that serves as the fulcrum 
of the rigid physical pendulum of the configuration modeling 
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part 21. The position of the shoulder joint can be 
calculated by any methods as long as they regard it as a 
point in a 3D space and compute its coordinate value and 
velocity and acceleration. 
5 Based on the joint position determined by the joint 

position determination part 22, the motion modeling part 23 
creates, following the designated modeling scheme, a motion 
model by generating an interpolation formula or equation of 
motion representing the arm-motion state through the use of 

10 the configuration model and physical quantities output from 
the configuration modeling part 21. 

Next, the arm angle calculating part 24 calculates the 
angle representative of the configuration of the arm at a 
certain time t based on the equation of the motion model 

15 determined by the motion modeling part 23. in this instance, 
however, the angular position may be computed using plural 
motion models as described later on. 

While Fig. 1 shows a configuration model in which the 
rigid stick 11 between the both shoulder joints is rotatable 

20 on the y axis within a predetermined angular range and the 
coordinate positions (x s ,y s ,z s ) of each shoulder joint is 

defined by the angle 8 of the shoulder about the y axis and 
the half shoulder width W, the rigid stick 11 between the 

shoulder joints may be made rotatable on the x axis as well 

25 over a predetermined angular range with a view to creating a 

more realistic representation of the motion of the human 

figure model. Fig. 3 shows a configuration model in such an 

instance. In this example, the rigid stick 11 is shown to 
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have turned an angle 0 about the y axis and an angle 5 about 
the x axis. Hence, the coordinates (x Sf y Sf z s ) of the shoulder 

' joint is defined by the following equations using the angles 

9 and 5 and the half shoulder width W. 
5 x s = x o +WcosSsin0 

y s = yo+WsinS 
2 S = Zo +Wcos Scos8 
When the rigid stick 11 between the both shoulder joints is 

turned on the vertical coordinate axis y, centrifugal force 
10 is exerted on the left and right arms 12 outwardly thereof. 
The angle r of the constraint plane 15 to the vertical 

coordinate axis p may be changed according to the centrifugal 
force. In the present invention, the motions of the arms 12 1 

and 12 2 are defined by the angular positions <t>i and <j> 2 in the 
15 constraint plane 15 with respect to such given shoulder joint 

coordinates ( x s , y s , z s ) . 

In the configuration models of Figs. 1 and 3, the upper 
and lower arms 12 1 and 12 2 are shown to be movable in the same 
constraint plane 15, but in order to represent the motion of 

20 the arm model more faithfully to the actual arm motion, it is 
possible to divide the constraint plane 15, by a straight 
line passing through the elbow joint, into two independent 
constraint planes 15 1 and 15 2 for the upper and lower arms 12i 
and 12 2 , respectively. The constraint plane 152 containing 

25 the lower arm 12 2 is made rotatable over a predetermined range 
of angles about the upper arm 12 i. Letting the angle of 

rotation of the constraint plane 15 2 be represented by the 
angular position of the lower arm 12 2 in the constraint plane 
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15 2 can be defined by the angles <j> 2 and hence, once the 
coordinates (x e ,Ye,Ze) ot the elbow joint 16 are defined, the 
•position of the lower arm 12 2 can also easily be defined using 
these parameters. 
5 In the Fig. 2 embodiment the arm angle calculation part 

24 represents motions of respective parts based on one motion 
modeling scheme selected by the motion modeling part 23, the 
interpolation method has a defect that the motions becomes 
uniform and monotonous in the case of generating animations 
10 that do not primarily aim at motions accompanying the human 
walking, such as the arm motion or the like. In the case of 
representing motions based on the equation of motion, the 
number of degrees of freedom increases according to the model 
building method, resulting in an increase in the 
15 computational complexity. Further, since the method for 
generating animations from image data of the human body in 
motion by a video camera or position detected data by a 
magnetic sensor is difficult of application to various motion 
scenes, it is necessary to acquire a wide variety of motion 
20 data. In Fig. 5 there is illustrated in block form an 
embodiment of the invention that overcomes such defects. 

This embodiment is identical in basic configuration with 
the Fig. 2 embodiment but differs from the latter in that the 
motion modeling part 23 is provided with plural (three in 
25 this example) kinds of modeling section 23a, 23b and 23c for 
modeling the motion state of the arm 12 by different methods. 
Another point of difference is that the arm angle calculation 
part 24 has calculation sections 24a, 24b and 24c 
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1 respectively corresponding to the modeling sections 23a, 23b 

and 23c of the motion modeling part 23, Additionally, this 
- embodiment has an angle combine /output part 26 that performs 
weighted combining of calculated angles . This embodiment 
5 will be described below. 

As in the case of Fig. 2, the configuration modeling part 
21 is supplied with input data from the input part 6, such as 
sizes, mass, shapes and boundary conditions (movable ranges 
of respective parts of a multi-articulated model of the human 
10 body, and uses the data to dispose respective parts of a 
structure formed by rigid sticks linked by joints, an arm 

model in this case. While in Fig. 4 the angles <j>! and § 2 are 
chosen so that the counterclockwise direction about the rigid 
stick 11 is positive, any coordinate system can be used as 

15 long as the orientation or configuration of the arm 12 can be 
represented unequivocally. 

Next, the point position determination part 22 computes 
the positions of the shoulder joints 13 R and 13 L . The model 
of the shoulder is not limited specifically to that shown in 

2 0 Fig. 3 or 4 but may be others as long as the coordinates 
(x s ,y s/ z s ) of the should joint can be calculated. 

The motion modeling part 23 models the motion state of 
the arm model in the system of Fig. 4 by three different 
methods in this example. That is, based on the arm model and 

25 physical quantities determined in the configuration modeling 
part 21, the motion modeling part 23 determines modeling by 
equations of motion or modeling by equations of interpolation 
and outputs the models. 
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Let it be assumed, for example , that the coordinate 
system used is a system in which the arm 12 assumes a state 
qo=(t 0 ) at time t 0 , a state qi=q(ti) at time t x and a state 
q2=q(t 2 ) at time t 2 as shown in one constraint plane 15 in 
5 Fig. 6 and that constraints for the angles fa and fa are, for 
example, -n/2<fa<n/2 and 0«j> 2 <rr. 

In the motion modeling section 23a, the motions between 
the states q 0 , q x and q 2 are assumed to be linear motions, 

that is, the motion from the state q(t 0 ) to q(t 2 ) and from 
10 q(t 2 ) to q(t 2 ) are regarded as constant-speed motion states, 
and an equation of the motion state, which represents the 
angular position and/or angular velocity at given time t, is 
formulated using the linear interpolation method. 

In the motion modeling section 23b, the motion states 
15 between the states q 0 , q 1 and q 3 are assumed to be states of 
motion at a velocity approximated by a sine curve, for 
instance, and an equation of the motion state, which 
represents the angular position and/or angular velocity at 
given time 1, is formulated using the sine interpolation 
2 0 method . 

In the motion modeling section 23c, these states q 0 , q x 
and q 2 are assumed to be motion states that obey laws of 
physics, and they are defined as motions that result from the 
aforementioned Lagrange * s equation of motion ( 6 ) , where q is 

25 generalized coordinates (<j>i,<t> 2 ) of this system and Fq a 
generalized force concerning q. in this instance, the 
generalized force may be any force as long as the system can 
represent the states q 0 , q 2 and q 2 . 
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Then, the angle of the arm 12 is calculated in the arm 
angle calculation part 24. In the calculating section 24a, 

'angles (j> a i(t) and <t> a 2 (t) of the arm 12 at time t between t 0 and 
t 2 are calculated based on the motion state determined by the 
5 motion modeling section 23a. In the case of using a discrete 
time series t 0 , t 0 +At, t 0 +2At, t 2 , angles 4> a i(t k ) and 

<j> a 2 (t k ) are calculated with t^to+At, where 0sk£(t 2 -t 0 ) /At. 

in the calculating section 24b, angles <j) b l(t) and <|> b 2 (t) 
or <|> b i(t k ) and ^ 2 (t k ) of the arm 12 are calculated based on 
10 the motion state determined by the motion modeling section 

23b. 

In the calculating section 24c, angles 4> c i(t) and <t>° 2 (t) or 
( j ) o i ( t kj and (j) c 2 (t k ) of the arm 12 are calculated based on the 
motion state determined by the motion modeling section 23c. 
15 The angle combine /output part 26 performs weighted 

combining of angles ^(t) or ^±(t k ) (where i=l,2 and j=a,b,c) 
output from the arm angle calculation part 24. The angle is 
expressed by the following equation using, as weights, real 
numbers a, p and y such that tx+0+Y=l, where 0<[a,p,y]<l. 
4>i(t) = a<j) a i(t)+P<|) b i(t)+Y<i) c i(t), i=l,2 (7) 



20 



or 



c|>i(t k ) = a<t> a i(t k )+pci) b i(t k )+Y<t) c i(t k ), i=l,2 
0<K^(t2-tO) /At (8) 

When any one of the weights a, p and y is 1 and the others 
25 0s, the same results as in the Fig. 2 embodiment are 

obtained . 

In the combining of motion models, it is also possible to 
combine output values of angular velocities by such a linear 
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combination as Eq. (7) or (8) in each motion state and then 
calculate the joint angles, instead of such angles as 

mentioned above. The angular positions <j>! and (j> 2 of the upper 
and lower arms 12 x and 12 2 at each point in time t thus 
5 obtained are provided to the display part 7. As a result, a 
variety of motion states of the arm 12 close to natural arm 
motions can be generated with a small computational quantity. 

In this example, motions of the arm 12 can efficiently be 
calculated as motions accompanying those of the rigid stick 

10 11 between the both shoulders. Further, by combining or 

overlapping calculation results of plural motion states, it 
is possible to generate, for example, linear or dynamic 
motions alone, and by arbitrarily combining these motions, 
various other motion states can also be generated. 

15 While this example has been described in connection with 

the state transition of the arm motion from q 0 to q 1 and to 
q 2 , the same results as mentioned above could be obtained in 
the case of the state transition in the reverse direction 
from q 2 to q 2 and to q 0 or in the case of periodic motions as 

2 0 well. 

In the combining shown by Eqs. (7) and (8), different 
combinations of motion models for the individual rigid sticks 
of the multi-articulated structure may also be chosen. In 
such an instance, by selecting the combinations of motion 
25 models in accordance with the accuracy or complexity required 
for the respective rigid sticks, the computational quantity 
could efficiently be assigned to each of them. Turning next 
to Fig. 7, a description will be given of an embodiment which 
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facilitates implementation of such combinations. In this 
embodiment, for each parameter of the multi-articulated 
* structure modeling the human body, an optimum motion modeling 
method is selected in accordance with the processing 
5 efficiency and/or required reality. To this end, a motion 
model select part 27 is interposed between the motion 
modeling part 23 and the arm angle calculation part 24 to 
determine which motion modeling scheme (or constant) is used 
for each rigid stick. Moreover, this embodiment employs 
10 plural (three) sets of motion modeling select parts 27 and 
arm angle calculation parts 24 to prepare plural sets of 
different combinations of motion modeling schemes for each of 
the rigid sticks that model the arm, and as required, results 
of arm angle calculations by different set of such motion 
15 modeling schemes are subjected to weighted combining in the 
combine /output part 26. 

The configuration modeling part 21 determines the 
configuration of the arm as shown in Fig. 4, for instance. 
That is, the parameters that are designated in this case are 

20 the angle of rotation 6 of the shoulder about the axis in the 
forward direction (indicating rocking of the shoulder), the 

angle of rotation 8 of the shoulder about the axis in the 
vertical direction, the angle of rotation p of the constraint 
plane 15i containing the upper arm from the vertical plane 

25 (indicating the angle between the upper arm and the side of 
the human figure under the armpit), the angle fa of the upper 

arm 12 i in the constraint plane 15 lf the angle of rotation § 
of the constraint plane 15 2 containing the lower arm 12 2 about 
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the upper arm 12j and the angle (j> 2 of the lower arm 12 2 in the 
constraint plane 15 2 , and the reference position O is set at 
. the center of the shoulder in Fig. 4, for instance. 

Thereafter, the joint position determination part 22 
5 determines the position of the point 0 designated to be the 
origin in Fig. 4. When the configuration modeling part 21 
designates the coordinates (x 0 ,y 0 ,zo) of the origin 0 to be at 
another point, the joint position determination part 22 
determines the that position. For example, when the point 0 
10 is derivable from the motion of another part of the body, a 
certain point of that part is connected to the origin O. 

After this, the motion modeling part 23 determines 
procedures of plural motion modeling schemes to be used. 
While this embodiment employs three kinds of motion modeling 
15 schemes, any other schemes may be added. 

For example, the motion modeling section 23 utilizes 
dynamics. In this instance, the afore-mentioned Lagrange's 
equation of motion (6) for this coordinate system is 
formulated by a well-known scheme of dynamics. Here, the 
20 generalized coordinates q represent 5, 6, p R , p L , 4> R i, <t> L i/ 4^2/ 
<j> L 2, | R and l h , and the generalized force Fq is a torque 
corresponding to the individual coordinates, the suffixes R 
and L indicating the right and the left side, respectively, 
in this case, there exist 10 equations of motion for each 

25 coordinate. 

For example, the motion modeling section 23b determines 
the parameter value at each point in time by the linear 
interpolation scheme. For example, where the values q 0 and q x 
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of a certain motion state parameter q at initial and final 
points in time t 0 and t x of the motion are already determined, 
'the value at an arbitrary time t (where t 0 st<ti) between the 
initial and final points in time is determined by linear 
5 interpolation. The same goes for the case where a value at 
time t™ (where to^t^ti) is already determined at initial time 
t 0 . It is no problem how many such values exist at points 
between the initial and final ones. Further, the parameters 
may also take the same value from initial time t 0 to final one 
10 ti. 

For example, the motion modeling section 23c determines 
the parameter value at each time by such a nonlinear 
interpolation as a sine function interpolation. As is the 
case with the modeling section 23b, when the parameter value 
15 at a certain point in time is already determined, the value 
of the parameter q at each time t is determined by such a 
combination of second- and third-order equations and an 
elementary that the parameter takes the already value at that 
time . 

20 Following this, the motion model select part 27 

determined the motion state of the arm for which a 
calculation is actually conducted. For instance: 

(a) In the case of conducting dynamic calculations for 
all parameters, only the motion modeling section 23a is used. 

25 (b) A certain parameter is set at a fixed value and the 

motion modeling section 23b is used for the other remaining 
parameters . 

(c) A certain parameter is set at a fixed value, the 
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modeling section 23a is used for some of the remaining 
parameters , the modeling section 23b for some of the other 
remaining parameters and the modeling section 23c for the 
remaining parameters . 
5 By this, methods for computing all the parameters are 
determined . 

The arm angle calculation part 24 performs actual angle 
calculations in the calculating sections 24a, 24b and 24c 
following the parameter calculating methods determined as 
10 described above. In this instance, it is also possible, with 
a view to providing increased efficiency for the calculation 
procedure, to conduct calculations at each time in the 
following order: 

(a) Of the parameters handled by the modeling sections 
15 23b and 23, parameters independent on other parameter values 

are calculated; 

(b) Of the parameters handled by the modeling sections 
23b and 23, parameters dependent on other parameter values 
are calculated; 

20 (c) Parameters defined by the modeling section 23a are 

calculated. 

The results calculated in the arm angle calculation part 
24 may be used intact as output values, but other 
combinations of parameter calculating methods can be used. 
25 In the embodiment of Fig. 7, there are provided pairs of 
motion modeling select sections and angle calculation 
sections 27', 24 1 and 27", 24" similar to the pair of motion 
modeling part 27 and angle calculation part 24 so that a 
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combination of motion models to be applied to each rigid 
stick, different from the combination of motion models 
"selected by the motion model select part 27, is selected and 
that arm angles are calculated based on the newly selected 
5 combination of motion models. The results of angular 

position calculations by the arm angle position calculating 
parts 24, 24 ! and 24" for the rigid sticks respectively 
corresponding thereto are suitably weighted and combined in 
the combine /output part 26, from which the combined output is 
10 fed to the display part 7. In this case, the angle or 

angular velocity values at each point in time may also be 
combined - 

This embodiment is advantageous in that the computing 

time can be reduced as compared in the case of computing all 
15 parameters through utilization of dynamics in Fig. 4, for 

example, and that the value of a particular parameter can be 

varied arbitrarily or held constant. 

While the present invention has been described as being 

applied to the representation or creation of the motion state 
20 of the arm 12, it is evident that the invention is also 

applicable to the representation of the leg motion of a 

walking human, for instance. 

The animation generating methods of the present invention 

described previously with reference to Figs. 2, 5 and 8 are 
25 each prestored as animation generating sequences in a memory 

or similar recording medium and the animation is generated by 

a computer or DSP following the generating sequences read out 

of the recording medium. 
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EFFECT OF THE INVENTION 

As described in the above, according to the present 
1 invention, since motions of respective rigid sticks connected 

by joints to form a multi-articulated structure are 
5 represented by parameters in a constraint plane for easier 
recognition of their contribution to the motions, animations 
can efficiently be generated without any particular skill. 
Further, the joint is a model approximated by a physical 
pendulum and the joint motion is represented by an equation 

10 of motion formulated for the model — this permits more 

realistic calculation of motions of the arm joint or the 
like. Moreover, by using plural motion models and applying 
an arbitrary motion state to each parameter representing the 
arm, animations can efficiently be created and the individual 

15 parameters can be controlled with ease. Additionally, since 
angles or angular velocities formed by plural motion states 
are combined, a variety of motion states can be represented. 

It will be apparent that many modifications and 
variations may be effected without departing from the scope 

20 of the novel concepts of the present invention. 
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WHAT IS CLAIMED IS: 

1 . A method for generating animations of the human body- 
including both shoulders and arms modeled by a multi-articula 
ted structure formed by plural rigid sticks connected by 
joints , said method comprising the steps of: 

(a) defining a constraint plane in which said rigid 
sticks having modeled each of said arms are allowed to move 
about said joint connecting them; 

(b) determining parameters that define angular positions 
of said rigid sticks in said constraint plane and 
constructing motion models of said rigid sticks by using said 
parameters ; and 

(c) generating motions of said rigid sticks having 
modeled said each arm by calculating temporal changes in said 
angular positions of said rigid sticks on the bais of said 
motion models. 

2. The method of claim 1, wherein said step (b) includes 
a step of selectively applying either a motion modeling 
scheme using laws of physics or a different motion modeling 
scheme not based on said laws of physics for said parameters 
defining said angular positions of said rigid sticks. 

3. The method of claim 2, wherein there are prepared a 
plurality of said motion modeling schemes not based on said 
laws of physics. 

4. The method of claim 2 or 3, wherein said step (b) 
includes a step of constructing plural motion models for said 
parameters of said rigid sticks and said step (c) includes a 
step of performing weighted-combining of parameters generated 



-25- 



by said plural motion models. 

5- The method of claim 4, wherein said weighted-combining 
is linear weighted-combining. 

6. The method of claim 4, wherein said weighted-combining 
is nonlinear weighted-combining. 

7. The method of claim 4, wherein weights of said 
weighted-combining are changed with time. 

8. The method of claim 2 or 3, wherein said step (b) 
includes a step of approximating said motions of said rigid 
sticks by a physical pendulum to construct said motion models 
and formulating equations of motion for said models by said 
physical pendulum to represent said motions of said rigid 
sticks . 

9. The method of claim 2 or 3, wherein said physical 
pendulum includes two rigid sticks corresponding to upper and 
lower arms of said each arm and connected at one end by one 
joint to each other, one of said rigid sticks having its 
other end connected to the joint of one of said shoulders. 

10. The method of claim 2 or 3, wherein said step (b) 
includes a step of calculating the position of said joint 
serving as a fulcrum of said physical pendulum of said rigid 
sticks and said step (c) includes a step of calculating, by 
said equations of motion, angular positions or angular 
velocities representing the configurations of said rigid 
sticks at a certain point in time. 

11. The method of claim 10, wherein said step (b) 
includes a step of constructing a plurality of different 
models of said motions of said rigid sticks and said step (c) 
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includes a step of calculating said angular positions or 
angular velocities of said rigid sticks by using said 
• plurality of different models respectively corresponding 
thereto and performing weighted-combining of them to 
represent motion states of said rigid sticks. 

12. The method of claim 1, wherein: said step (b) 
includes a step of approximating said motions of said rigid 
sticks by a physical pendulum to construct arm models, 
determining motion modeling equations by applying equations 
of motion and an interpolation scheme to said arm models, and 
calculating the position of a joint which serves as a fulcrum 
of said physical pendulum of each of said arm models; and 
said step (c) includes a step of calculating, by said motion 
modeling equations, angular positions or angular velocities 
representing the configuration of said each arm at a certain 
point in time and performing weighted combining of said 
angular positions or angular velocities, thereby representing 
the motion state of said each arm. 

13. The method of claim 12, wherein said step (b) 
includes a step of determining physical quantities including 
the lengths, mass, centroids, maximum expansion and bending 
angles of said upper and lower arms of said each arm for said 
modeling of motions of said arm models. 

14. The method of claim 12, wherein said equations of 
motion are determined on the assumption that motions of said 
arm models are motions by models constructed by approximating 
said joint. 

15. The method of claim 12, wherein said equations of 
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motion are overlapped with functions representing preset 
motions, thereby representing motions of said each arm. 

16- The method of claim 12, wherein the step of 
calculating the position of said joint includes a step of 
calculating the coordinate value, velocity and acceleration 
of said joint regarded as a point in a 3D space. 

17. The method of claim 12, wherein said weighted-combini 
ng is linear weighted-combining. 

18. The method of claim 12, wherein said weighted-combini 
ng is nonlinear weighted-combining. 

19. The method of claim 12, wherein weights of said 
weighted-combining are changed with time. 

20. The method of claim 12, wherein parameters which 
defines motions of said rigid stick joining said both 

shoulders include an angle 9 through which said rigid stick 
is rotated on a vertical coordinate axis passing through the 
center of said rigid stick joining said both shoulders. 

21. The method of claim 20, wherein parameters which 
defines motions of said rigid stick joining said both 

shoulders include an angle 5 through which said rigid stick 
is rotated on a horizontal coordinate axis passing through 
the center of said rigid stick joining said both shoulders. 

22. The method of claim 20, which further includes a step 

of determining an angle p between said constraint plane 
containing said rigid sticks modeling said each arm and said 
vertical coordinate axis in response to centrifugal force 
caused by the rotation of said both arms resulting from said 
rotation of said rigid stick on said vertical coordinate 
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axis . 

23. An apparatus for generating animations of the human 
body including both shoulders and arms modeled by a multi- 
articulated structure formed by plural rigid sticks connected 
by joints , said apparatus comprising: 

configuration modeling means for disposing said rigid 
sticks in respective constraint planes; 

shoulder position calculating means for calculating the 
position of a joint of each of said shoulder; 

motion modeling means for determining motion models 
representing motions of said rigid sticks; and 

arm angle calculating means for calculating, for each of 
said motion models, the angular position of said each arm 
representing its configuration at a given point in time. 

24. The apparatus of claim 23, wherein said motion 
modeling means includes plural modeling sections for modeling 
motions of said rigid stick of said each arm with plural 
different models and said arm angle calculating means 
includes plural calculating sections for calculating the 
angular positions or angular velocities of said each arm by 
using said motion models determined by said plural modeling 
sections, and which further includes angle combine /output 
means for performing weighted combining of said plural 
angular positions or angular velocities calculated by said 
plural calculating sections of said arm angle calculating 
means, thereby obtaining the angular position or angular 
velocity of said each arm. 

25. The apparatus of claim 23, wherein said motion 
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modeling means includes plural modeling sections for modeling 
motions of said rigid stick of said each arm with plural 
different models and said arm angle calculating means 
includes plural calculating sections for calculating the 
angular positions or angular velocities of said each arm by 
using said motion models determined by said plural modeling 
sections, and which further includes motion model select 
means for selectively designating, for each of said rigid 
sticks, which one of said motion models by said plural 
modeling sections is to be used to calculate said angular 
positions • 

26. The apparatus of claim 25, which further comprises 
said motion modeling means and said arm angle calculating 
means provided in pairs, said motion model select means of 
said pairs selecting a different combination of motion models 
for said each rigid stick, and combine /output means whereby 
angular positions or angular velocities output from said arm 
angle calculating means of said pairs are subjected to 
weighted combining for each corresponding rigid stick. 

27. The apparatus of claim 24 or 25, wherein said plural 
motion models include motion models by an equation of motion 
based on laws of physics and motion models based on an 
interpolation scheme. 

28. The apparatus of claim 27, wherein said motion models 
based on said interpolation scheme include a motion model of 
the motion of said each rigid stick by approximating it by a 
uniform angular velocity motion and using a linear 
interpolation scheme, a motion model of the motion of said 
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each rigid stick by approximating it by a sine function and 
using a sine function interpolation scheme, and a motion 
model of the motion of said each rigid stick by using an 
equation of motion which obeys laws of physics. 

29. The apparatus of claim 24 or 25, wherein said 
configuration modeling means is means for modeling the motion 
of said each arm as a physical pendulum with its fulcrum at 
each of said shoulders. 

30. The apparatus of claim 29 , wherein said physical 
pendulum contains two rigid sticks corresponding to upper and 
lower arms of said each arm and connected at one end by a 
joint to each other, one of said rigid sticks having its 
other end connected to the joint of one of said shoulders. 

31. The apparatus of claim 23, wherein said motion 
modeling means is means for modeling the motion of an arm 
model of said each arm and the motion of a shoulder model of 
each of said shoulders independently of each other. 

32. The apparatus of claim 23, wherein said motion 
modeling means is means for modeling by overlapping an 
equation of motion of an arm model of said each arm with a 
preset function representing a motion. 

33. The apparatus of claim 23, wherein said configuration 
modeling means includes means whereby said rigid stick having 
modeled said shoulder is modeled so that it rotates at its 
center lengthwise thereof about a vertical coordinate axis 

within the range of a predetermined angle 0 . 

34. The apparatus of claim 23, wherein said configuration 
modeling means includes means whereby said rigid stick having 
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modeled said shoulder is modeled so that it rotates at its 
center lengthwise thereof about a horizontal axis within the 

range of a predetermined angle 6. 

35. A recording medium which has recorded therein a 
procedure for generating animations of the human body 
including both shoulders and arms modeled by a multi-articula 
ted structure formed by plural rigid sticks connected by 
joints, said procedure comprising the following sequence of 
operations of: 

(a) defining a constraint plane in which said rigid 
sticks having modeled each of said arms are allowed to move 
about said joint connecting them; 

(b) determining parameters that define angular positions 
of said rigid sticks in said constraint plane and 
constructing motion models of said rigid sticks by using said 

parameters ; and 

(c) generating motions of said rigid sticks having 
modeled said each arm by calculating temporal changes of said 
parameters . 

36. The recording medium of claim 35, wherein said 
operation (b) includes an operation of selectively applying 
either a motion modeling scheme using laws of physics or a 
different motion modeling scheme not based on said laws of 
physics for said parameters defining said angular positions 
of said rigid sticks. 

37. The recording medium of claim 35 , wherein: said 
operation (b) includes an operation of approximating said 
motions of said rigid sticks by a physical pendulum to 
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construct arm models, determining motion modeling equations 
by applying equations of motion and an interpolation scheme 
to said arm models, and calculating the position of a joint 
which serves as a fulcrum of said physical pendulum of each 
of said arm models; and said operation (c) includes an 
operation of calculating, by said motion modeling equations, 
angular positions or angular velocities representing the 
configuration of said each arm at a certain point in time and 
performing weighted combining of said angular positions or 
angular velocities, thereby representing the motion state of 
said each arm. 
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ABS TRACT OF THE DISCLOSURE 

The present invention offers a method for generating 
animations of a multi-articulated structure, a recording 
medium with the method recorded therein and an animation 
generating apparatus using the method- Motions of rigid 
sticks which approximate the upper arm connected to the 
shoulder joint and the lower arm connected by the elbow joint 
to the upper arm are modeled, by an interpolation scheme 
and/or equations of motion based on laws of physics, as 
temporal changes in angular positions in their respective 
constraint planes and the generated results are combined and 
output . 
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